logo
Dates

Author


Conferences

Tags

Sort by:  

Authors: Dan Sun, Theofilos Papapanagiotou
2023-04-21

tldr - powered by Generative AI

K-Serve is a tool for deploying machine learning models that can handle large language models with billions of parameters. It allows for easy deployment and management of models, as well as the ability to observe and analyze model performance.
  • K-Serve allows for easy deployment and management of machine learning models
  • It can handle large language models with billions of parameters
  • Observation and analysis of model performance is possible with K-Serve
  • The future of K-Serve is to support even larger language models
Authors: Huamin Chen, Yuval Lifshitz
2023-04-21

tldr - powered by Generative AI

The presentation discusses the urgent need for energy efficiency in the data center industry and proposes a solution using Kepler and Rook technologies to measure and correlate workload energy consumption with carbon emissions.
  • The integration of AI into search engines will lead to a significant increase in energy consumption in the data center industry
  • The industry's carbon footprint is comparable to that of the airline industry and is growing faster
  • Metrics and measurements are needed to accurately assess energy efficiency and carbon emissions
  • Kepler and Rook technologies can be used to measure and correlate workload energy consumption with carbon emissions
  • Linear and non-linear models can be used to create energy consumption models
  • The created models can be uploaded to GitHub and used in a Prometheus container
  • The solution can be run on both virtual and physical machines
Authors: Dawn Foster
2021-10-14

tldr - powered by Generative AI

The presentation discusses metrics and best practices for maintaining healthy open source projects, with a focus on interpreting data and adjusting strategies based on project needs.
  • The CNCF Contributor Strategy Tag has governance and contributor growth working groups that provide guidance for maintaining healthy open source projects.
  • The TO DO group has guides for creating and managing healthy open source projects.
  • The Chaos Metrics Community has defined metrics and tools for understanding and improving project health.
  • Interpretation is key when evaluating project health, as each project is unique and metrics should be adjusted based on project needs.
  • Metrics for responsiveness can include time to first response and time to close issues and pull requests.
  • Interpreting responsiveness metrics requires considering external factors such as conferences and holidays.
  • Adjusting contributor recruitment and mentorship strategies can improve responsiveness metrics.
  • Tracking and interpreting metrics over time can help identify areas for improvement and ensure project health.